Improved Hessian approximation with modified secant equations for symmetric rank-one method
نویسندگان
چکیده
Symmetric rank-one (SR1) is one of the competitive formulas among the quasi-Newton (QN) methods. In this paper, we propose some modified SR1 updates based on the modified secant equations, which use both gradient and function information. Furthermore, to avoid the loss of positive definiteness and zero denominators of the new SR1 updates, we apply a restart procedure to this update. Three new algorithms are given to improve the Hessian approximation with modified secant equations for the SR1 method. Numerical results show that the proposed algorithms are very encouraging and the advantage of the proposed algorithms over the standard SR1 and BFGS updates is clearly observed.
منابع مشابه
The modified BFGS method with new secant relation for unconstrained optimization problems
Using Taylor's series we propose a modified secant relation to get a more accurate approximation of the second curvature of the objective function. Then, based on this modified secant relation we present a new BFGS method for solving unconstrained optimization problems. The proposed method make use of both gradient and function values while the usual secant relation uses only gradient values. U...
متن کاملA Limited-Memory Multipoint Symmetric Secant Method for Bound Constrained Optimization
A new algorithm for solving smooth large-scale minimization problems with bound constraints is introduced. The way of dealing with active constraints is similar to the one used in some recently introduced quadratic solvers. A limited-memory multipoint symmetric secant method for approximating the Hessian is presented. Positive-definiteness of the Hessian approximation is not enforced. A combina...
متن کاملOn a Geometric Interpretation of the Positive Definite Secant Updates Bfgs and Dfp from the Wedderburn Formula
The BFGS update and the DFP update perhaps are respectively the most successful Hessian and inverse Hessian approximations for unconstrained minimization problems This paper describes a geometric meaning of these updates understood from the Wedderburn rank one reduction formula
متن کاملRank Modifications of Semi-definite Matrices with Applications to Secant Updates
The BFGS and DFP updates are perhaps the most successful Hessian and inverse Hessian approximations respectively for unconstrained minimization problems. This paper describes these methods in terms of two successive steps: rank reduction and rank restoration. From rank subtractivity and a powerful spectral result, the first step must necessarily result in a positive semidefinite matrix; and the...
متن کاملOn the stratification of secant varieties of Veronese varieties via symmetric rank
When considering σr(X), the variety of r-secant P r−1 to a projective variety X, one question which arises is what are the possible values of the X-rank of points on σr(X), apart from the generic value r? This geometric problem is of particular relevance (also for Applied Math) when X is a variety parameterizing some kind of tensors. We study here the case when X is a Veronese variety (i.e. the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- J. Computational Applied Mathematics
دوره 235 شماره
صفحات -
تاریخ انتشار 2011